The Use of Global Rating Scales for OSCEs in Veterinary Medicine

نویسندگان

  • Emma K. Read
  • Catriona Bell
  • Susan Rhind
  • Kent G. Hecker
چکیده

OSCEs (Objective Structured Clinical Examinations) are widely used in health professions to assess clinical skills competence. Raters use standardized binary checklists (CL) or multi-dimensional global rating scales (GRS) to score candidates performing specific tasks. This study assessed the reliability of CL and GRS scores in the assessment of veterinary students, and is the first study to demonstrate the reliability of GRS within veterinary medical education. Twelve raters from two different schools (6 from University of Calgary [UCVM] and 6 from Royal (Dick) School of Veterinary Studies [R(D)SVS] were asked to score 12 students (6 from each school). All raters assessed all students (video recordings) during 4 OSCE stations (bovine haltering, gowning and gloving, equine bandaging and skin suturing). Raters scored students using a CL, followed by the GRS. Novice raters (6 R(D)SVS) were assessed independently of expert raters (6 UCVM). Generalizability theory (G theory), analysis of variance (ANOVA) and t-tests were used to determine the reliability of rater scores, assess any between school differences (by student, by rater), and determine if there were differences between CL and GRS scores. There was no significant difference in rater performance with use of the CL or the GRS. Scores from the CL were significantly higher than scores from the GRS. The reliability of checklist scores were .42 and .76 for novice and expert raters respectively. The reliability of the global rating scale scores were .7 and .86 for novice and expert raters respectively. A decision study (D-study) showed that once trained using CL, GRS could be utilized to reliably score clinical skills in veterinary medicine with both novice and experienced raters.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Assessing Communication Skills of Medical Students in Objective Structured Clinical Examinations (OSCE) - A Systematic Review of Rating Scales

BACKGROUND Teaching and assessment of communication skills have become essential in medical education. The Objective Structured Clinical Examination (OSCE) has been found as an appropriate means to assess communication skills within medical education. Studies have demonstrated the importance of a valid assessment of medical students' communication skills. Yet, the validity of the performance sc...

متن کامل

طراحی چک لیست ارزیابی مهارت‌های عملی دانشجویان دندانپزشکی در درس بیماری‌های دهان و فک و صورت و مقایسه آن با روش Global rating

Background and Aims: The objective of this study was the development of a checklist for assessment of students’ clinical skills in the clinical oral medicine. The second aim was the assessment of stake holders’ satisfaction of this checklist in comparison to the routine global rating method. Materials and Methods: The checklist was developed in an expert panel sessions and the ...

متن کامل

The Goal-Oriented Evaluation of Medical Students during Internship Based on Performance Rating Tables

Background: development in students' training management that emphasizes on using objective methods and more faculties' engagement in students evaluation, were motivation for application tools such as flowchart, checklists and rating scales. This study examined the effectiveness of Performance Rating Tables (PRTs) in evaluation of medical interns in Mashhad, Iran. Methods: Internship Performanc...

متن کامل

Developing Rating Scale Descriptors for Assessing the Stages of Writing Process: The Constructs Underlying Students' Writing Performances

The purpose of the present study is to develop appropriate scoring scales for each of the defined stages of the writing process, and also to determine to what extent these scoring scales can reliably and validly assess the performances of EFL learners in an academic writing task. Two hundred and two students’ writing samples were collected after a step-by-step process oriented essay writing ins...

متن کامل

The Evaluation of Anxiety, Depression and Global Assessment of Functioning in Bipolar Patients at Manic and Mixed Episodes

Background and Aims: This research is carried out with the aim of comparing anxiety, depression and global assessment of functioning between two groups of bipolar patients at mixed and manic episodes. Methods: Using an analytical cross-sectional approach, a sample of 94 patients with mean age of 32 years old (Standard Deviation: 11.3), who had been categorically diagnosed with bipolar disorder ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره 10  شماره 

صفحات  -

تاریخ انتشار 2015